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Abstract 

We prove a generalization of a conjecture of Dokos, Dwyer, Johnson, Sagan, and Selsor 
giving a recursion for the inversion polynomial of 321-avoiding permutations. We also answer 
a question they posed about finding a recursive formulas for the major index polynomial of 
321-avoiding permutations. Other properties of these polynomials are investigated as well. 
Our tools include Dyck and 2-Motzkin paths, polyominoes, and continued fractions. 



1 Introduction 

The main motivation for this paper is a conjecture of Dokos, Dwyer, Johnson, Sagan, and Selsor [5] 
about inversion polynomials for 321-avoiding permutations which we will prove in generalized form. 
We also answer a question they posed by giving a recursive formula for the analogous major index 
polynomials. We first introduce some basic definitions and notation about pattern avoidance and 
permutation statistics. 

Call two sequences of distinct integers vr = ai . . . and a = bi . . .b^ order isomorphic whenever 
ai < Qj if and only if bi < bj for all i,j. Let 6„ denote the symmetric group of permutations of 

[n] =^ {!,••• ,n}. Say that a G &n contains n E &k as a pattern if there is a subsequence a' of 
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a order isomorphic to vr. If o contains no such subsequence then we say o avoids vr and write 
Av„(7r) for the set of such a G ©„. 

Let Z and N denote the integers and nonnegative integers, respectively. A statistic on ©„ is a 
function st : ©„ — )■ N. One then has the corresponding generating function 

fn = E 

o-ee„ 

Two of the most ubiquitous statistics for a = bi . . .bn are the inversion number 

inv a = \ i <j and bi > bj} 

where the hash sign denotes cardinahty, and the major index 

maj a = i. 

bi>bi+i 

In [T6] , Sagan and Savage proposed combining the study of pattern avoidance and permutations 
statistics by considering generating functions of the form 

o-GAv„(7r) 

for any pattern tt and statistic st. Dokos et al. [5j were the first to carry out an extensive study of 
these generating functions for the inv and maj statistics. We note that when st = inv and vr = 132 
we recover a g-analogue of the Catalan numbers studied by Carlitz and Riordan [2]. Work on 
the statistics counting fixed points and excedances has been done by Elizalde [6l [7], Elizalde and 
Deutsch and Elizalde and Pak [9j. 

Our primary motivation was to prove a conjecture of Dokos et al. concerning the inversion 
polynomial for 321-avoiding permutations. In fact, we will prove a stronger version which also 
keeps track of left-right maxima. Call in vr = ai . . . a„ a left-right maximum (value) if = 
max{ai, . . . , ai}. We let 

LrmTT = {ai | is a left-right maximum} 
and Irmvr = T^Lrmvr. Consider the generating function 

In{q,t)= E r^'^t'™^ (2) 

o-eAv„(321) 

Note that since #Av„(321) = C„, the nth Catalan number, this polynomial is a g, t-analogue of 
Cn- Our main result is a recursion for In{q,t). The case t = 1 was a conjecture of Dokos et al. 

Theorem 1.1. For n > 1, 

n-2 

In{q, t) = tln-i{q, t) + Y^ q^^^h{q, t)/n-fc-l(g, t). 

k=0 
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The rest of this paper is structured as follows. In the next section we will give a direct bijective 
proof of Theorem 11.11 using 2-Motzkin paths. The following two sections will explore related ideas 
involving Dyck paths, including a combinatorial proof of a formula of Fiirlinger and Hofbauer [TT] 
and two new statistics which are closely related to inv. Sections[5]and[6]are devoted to polyominoes. 
First, we give a second proof of Theorem 11.11 using work of Cheng, Eu, and Fu [3]. Next we 
derive recursions for a major index analogue, M„(g, t), of (|2]), thus answering a question posed 
by Dokos et al. in their paper. In Section [TJ we explore further properties of Mn{q,t), including 
symmetry, unimodality, and its modulo 2 behavior. The final two sections are concerned with 
continued fractions. We begin by giving a third proof of Theorem 11.11 using continued fractions 
and comparing it with a result of Krattenthaler [H]. In fact, this demonstration is even more 
general since it also keeps track of the number of fixed points. And in Section |9] we reprove 
and then generalize a theorem of Simion and Schmidt [17] concerning the signed-enumeration of 
321-avoiding permutations. 



2 A proof of Theorem 11.11 using 2-Motzkin paths 



Our first proof of Theorem 11.11 will use 2-Motzkin paths. Let U (up), D (down), and L (level) 
denote vectors in with coordinates (1,1), (1,-1), and (1,0), respectively. A Motzkin path of 
length n, M = lattice path where each step Si is U, D, or L and which begins at the 

origin, ends on the x-axis, and never goes below y = 0. A 2-Motzkin path is a Motzkin path where 
each level step has been colored in one of two colors which we will denote by Lq and Li. We will 
let Ain denote the set of 2-Motzkin paths of length n. 

It will be useful to have two vectors to keep track of the values and positions of left-right 
maxima. If cr = 6i . . . 6„ G ©n then let 



where 

Also define 
where 



Pi 



valcr = (fi, ...,Vn) 



1 if z is a left-right maximum of a, 
else. 



posa = (pi, . . . ,Pn) 

1 if bi is a left-right maximum of a, 
else. 



By way of example, if a = 361782495 then we have valo" = (0,0,1,0,0,1,1,1,1) and poser = 
(1, 1, 0, 1, 1, 0, 0, 1, 0). Note that for any permutation f „ = pi = 1. 

We will need the following lemma which collects together some results from the folklore of 
pattern avoidance. Since they are easy to prove, the demonstration will be omitted. 

Lemma 2.1. Suppose a G (3„. 

(a) We have o G Av„(321) ij and only if the elements of [n] — Lrmo" form an increasing subse- 
quence of a. 
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Figure 1: The Motzkin path associated with a = 361782495 



(b) Suppose we are given 0-1 vectors v = (t>i, . . . , Vn) and p = {pi, . . . ,pn) with the same positive 
number of ones. Then v = valcr and p = posa for some a e if and only if, for every 
indexi, 1 < i < n, the number of ones inpi, . . . ,Pi is greater than the number invi, . . . , Vi-i. 
In this case, because of part (a), there is a unique such a G Av„(321). □ 

Note that in (b) the cases where i = 1 and i = n force pi = 1 and = 1, respectively. 
First proof of Theorem 11.11 We will construct a bijection /i : Av„(321) — > Ai^-i follows. 
Given a G Av„(321) with vala = (fi,...,t>„) and posa = (pi,...,p„), we let /i(cr) = M = 
si . . . Sn-i where 

' U if f j = and pj+i = 1, 
D if Vi = 1 and pj+i = 0, 
Lo if Vi = pi+i = 0, 
^Li iivi=pi+i = l. 

Continuing the example from the beginning of the section, a = 361782495 would be mapped to 
the path in Figure [H 

We must first show that fi is well defined in that if M = /i(cr) then M ends on the x-axis and 
stays weakly above it the rest of the time. In other words, we want the number of f/'s in any 
prefix of M to be at least as great as the number of D's, with equality at the finish. This now 
follows from the definition of the Si and the first two sentences of Lemma [2.11 (b). 

We must also check that yU is a bijection. The fact that it is injective is an immediate conse- 
quence of the definition of the Sj and the third sentence of Lemma [2.11 (b). Since # Av„(321) = 
Cn = #A^„_i, we also have bijectivity. 

If /x(ct) = M then we claim that 

Irma = #f/(M) + #Li(M) + 1, (3) 
inva = #D(M) + #Lo(M) +areaM, (4) 

where areaM is the area between M and the x-axis, U{M) is the set of steps equal to U in M, 
and similarly for the other types of steps. The first equation follows from the definition of M and 
the fact that Irma is the number of ones in posa. The -|-1 is because M has length n — 1 and we 
always have pi = 1. 

To prove the equation for inv, we will induct on n. Note that every M G M.\_i, where n > 2, 
can be uniquely decomposed in one of the following ways: 

(i) M = LqN, where N G M'i^l^, 

(ii) M = LiN, where N G Mi^la- 
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(iii) M = UNDO, where G Ml\ and O G Al;ife_2 some 1 < < n - 2. 

Suppose (jlj) holds for in case (i), and suppose /i(7r) = N. If we have val n = (t>i, . . . , Vn-i) and 
posTT = (pi, . . . ,p„_i) then adding Lq forces the vectors to change to val a = (0, vi, . . . , f„_i) and 
poser = (1, 0,p2, . . . ,Pn~i)- It follows that if vr = ai . . . a„_i then a = (ai + l)l(a2 + l) . . . (a„_i + l). 
So both the left and right sides of (jl]) go up by one when passing from tt to a and equality is 
preserved. Similar arguments shows that both sides stay the same in case (ii), and both go up by 
/c + 1 in case (iii). So equality is maintained in all cases. 

From what we have shown, it suffices to show that 



satisfies the recurrence in Theorem 11.11 Considering the three cases above, in (i) we get a contri- 
bution of qln-ii^, t) to In{q, t) which corresponds to the k = term of the sum. Similarly, case (ii) 
contributes tl'^_^[q,t). Finally, in (iii) the piece UND contributes tq^^^Ik{q,t) since when lifting 
N the area is increased by k, and both ^U{N) and ^D[N) are increased by one. Also O con- 
tributes J„_fc_i(g, t)/t since there is a -|-1 in the exponent of t for both Ik{q,t) and /„_fc_.i(g, t), 
but we only want one such. Combining these contributions proves the recursion. □ 

3 Dyck paths and an equation of Fiirlinger and Hofbauer 

In this section we will prove a formula of Fiirlinger and Hofbauer [TTl equation (5.5)] which is 
closely related to Theorem ll.il In fact, we will show in Section [5] that this equation can be used to 
prove our main theorem. Our proof of the Fiirlinger-Hofbauer result will be combinatorial using 
Dyck paths, whereas the one given in [TT] is by algebraic manipulation of generating functions. 
Our proof has the interesting feature that it uses a nonstandard decomposition of Dyck paths 
which will also be useful in the next section. 

Let P = Si . . . S2n be a Dyck path of semilength n and let P„ be the set of all such P. We 
will freely go back and forth between three standard interpretations of such paths. In the first, P 
consists of n [/-steps and n D-steps starting at the origin and staying weakly above the x-axis. 
It the second, there are n north steps, = (0, 1), and n east steps, E = (1,0), beginning at the 
origin and staying weakly above the line y = x. In the last, we have n zeros and n ones with 
the number of zeros in any prefix of P being at least as great as the number of ones. In this last 
interpretation, we can apply all the usual permutation statistics defined in the same way as they 
were when there were no repetitions. In particular, we will need the descent set of P 



and the descent number desP = j^DesP. A descent of P as a bit string corresponds to a valley 
of P in the first interpretation, i.e., a factor of the form DU. We will also need the dual notion of 
a peak, which is a factor UD. 

We also need to define one of the analogues of the Catalan numbers studied by Fiirlinger 
and Hofbauer. Given a Dyck path P = si . . . S2n we let |P|o and |P|i be the number of zeros and 




■^#UiP)+#Li(P)+l 



DesP = {i \ ai > Oj+i} 
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number of ones in P, respectively. More generally we will write \w\a for the number of occurrences 
of A in the word w for any A and w. Now let 

pi{w) = si...Si (5) 

be If 's prefix of length i. Define 

a{P) = Yl IP*(^)lo' 

iGDesP 
ieDesP 

Note that <y{P) + f3{P) = maj P. Now consider the generating function 

= Cn{a, b-t)=J2 a^^'^h^^^'h^-^. (6) 

Theorem 3.1 (Fiirlinger and Hofbauer [H]). We have 

n-2 

C^{t) = Cr^^iiabt) +btY,ci'^'Ck{abt)Cn-k-i{iabf^^^^ (7) 

fc=0 

Proof. We will first define a bijection 5 : l+J^Io^^fc x Vn-k-i — ^ ^^n- Given two Dyck paths 

Q = V'^D^^U'^'D^^ . . . U^'D^^ e Vk and R = U'^W^^U^'W'^^ . . . U^W^' e V^-k-i 

where all exponents are positive, we will combine them to create a Dyck path P = 6{Q, R) G Vn 
as follows. (When Q is empty, the same definition works with the convention that ai = 6i = 0). 
There are two cases: 

1. If P = 0, then 

p _ Jjai+l p^bi+ljja2 p)b2 JJ""^ JJ^" 

2. If P ^ 0, then 

p — Jjai + ^ p)JJ0.2 p^bijja^ p^b2 Jjcis p)bs-i Jjci pjba+dijjC2 pjd2 JJ'^* P)"^* 

For example, 

6{U^D^UD'^,UDU'^DUD'^) = U^DUD'^UD^U'^DUD'^, 

as illustrated in Figure O The path P is given by the solid lines while Q is dashed and R is dotted, 
with Q being shifted to start at (2,0) and R concatenated directly after, starting at (10,0). Note 
that this puts the peaks of Q at exactly the same position as the valleys of the first part of P, and 
makes R and P coincide after the first peak of R 

To show that 6 is bijective, we construct its inverse. Suppose that 

p = U'W^^U'W^^ . . . U^'^D^K 

Again, there are two cases for computing 5^^{P) = {Q,R). 
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Figure 2: The decomposition of Dyck paths 

1. If ji > 2, then 

Q = f/n-i/}Ji-if/*2/)i2 _ _ _ jjikj^h and = 0. 

2. If ji = 1, let s be the smallest index such that ii + «2 + ■ ■ ■ + < j2 + js + ■ ■ ■ + js+i (note 
that s < k), and let e = j2 + js + ■ ■ ■ + js+i — (^i + ^2 + ■ ■ ■ + ^s)- Then 

The first case is easy to understand as you just shorten the first peak of P which had been 
lengthened by S. For the second case, the reader may find it useful to consult Figure [2] again. As 
in defining 6, Q is the Dyck path that starts at (2, 0) and has the peaks at the valleys of P. At 
some point this will no longer be possible because Q would have to go under the x-axis. Q ends at 
the point on the x-axis just before it would be forced to go negative, and R starts at that point. 
The path R begins with up-steps until it hits P, and then coincides with P for the rest of the 
path. 

We now use our bijection to prove the theorem. \i P e and 5"^(P) = {Q,R), then the 
term C„_i(a6t) corresponds to the case when = 0, since then adding the extra UD to the first 
peak moves all the valleys over by one unit. When i? 7^ 0, suppose Q E and R G "Dn^fc-i. 
The factor C„_fc_i((a6)'^+^t) comes from the fact that all the valleys of R become valleys of P, 
each one having k + 1 additional steps U and D to their left. The term Ck{abt) accounts for the 
fact that when the valleys of Q become valleys of P, they have an additional U and D inserted to 
their left, namely the first D in P and the U preceding it, and the term abt accounts for the extra 
valley started by this D. Finally, the factor comes from the fact that when the k up-steps of Q 
are put in P, they are shifted one valley to the left of the corresponding valley in P. Thus each 
of these steps moves the corresponding valley one position to the right. □ 

The decomposition in Theorem 13.11 is based on the structure of the first peak of P. If we 
consider the last peak of P, we will get the following equation which does not appear in 

Theorem 3.2. We have 

n-l 

Cn{t) = Cn-i{t) + a''-hY,b''Ck{t)Cn-k-i{{ab)H). 

k=l 

Proof. We define a second bijection A : I+J^Zq x T^n-k-i T^n as follows. Given two Dyck 
paths 

R = u^W^'WW^^ . . . U^W^' e Vk and Q = U""' D^'U^W^^ . . . U^'D^' e V^-k-i 
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Figure 3: The bijection T 



1. UR = 0, then 




2. If ^ 0, then 



p — Jjci jjdijjC2 jjd2 Jjct+ai p^dtjja2 p)bijja:i p^b2 Jjas p)bs 



Now using similar arguments to those in the proof of Theorem 13. we get the desired result. □ 

4 The sumpeaks and sumtunnels statistics 

In this section we discuss another pair of (new) statistics on Dyck paths, which are closely related 
to the inv statistic on 321-avoiding permutations. In fact, these two statistics are equidistributed 
over &n, as we will show. First we will need some definitions and notation. 

Let npeaP denote the number of peaks of P, and note that npeaP = desP + 1 for any 
non-empty Dyck path P. Also define the height of a peak p = UD = SjSj+i in a Dyck path 
P = si . . . S2n to be 



where pi is as in equation In the interpretation of Dyck paths using steps U and D, ht(p) is 
the y-coordinate of the highest point of p. In Figure [2|, the peaks of P have heights 4, 4, 3, 2, and 
2. 

To make a connection with permutations tt = ai . . . a„, we consider the diagram of vr, which is 
a square grid with a dot in column j at height aj for all j G [n] . Figure 2 displays the permutation 
TT = 341625978 G Av9(321). We will now describe a bijection F : Av„(321) — )■ P„ which appeared 
in [H] (where it is denoted by tp^), and in a slightly different form in [H]. Imagine a light shining 
from the northwest of the diagram of vr so that each dot casts a shadow with sides parallel to the 
axes. Consider the lattice path P formed by the boundary of the union of these shadows. (This 
is the same procedure as used by Viennot [19] in his geometric version of the Robinson-Schensted 
correspondence.) Define r(7r) = P. Again, Figure 2 illustrates the process. Using Lemma fH] 



ht{p) = \Pi{P)\u - MP)\d, 



(8) 
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Figure 4: The tunnels of a Dyck path 



one can prove that for any permutation vr G ©„, the path P will stay above y = x and so be a 
Dyck path. Lemma [2.11 also shows that if one restricts to tt G Av„(321), then this map becomes 
a bijection. The inv and Irm statistics on tt translate nicely under F. 

Proposition 4.1. IfT(n) = P, then 

(a) Irmvr = npeaP, 

(b) invTT = Ylpi^^ip) ~ where the sum is over all peaks p of P. 

Proof. For (a), just note that every left-right maximum of vr is associated with a peak p = NE of 
P consisting of two of the edges of the square containing the maximum. And this correspondence 
is clearly reversible. 

For (b), since vr = oi . . . a„ avoids 321, each inversion of vr has the property that is a 
left-right maximum but aj is not. There is a two-to-one correspondence between elements of tt 
and steps of P, where corresponds to the pair (A^j, Ei) which are the projections horizontally 
and vertically onto P, respectively. Now (^, j) is an inversion if and only if Nj comes before Ni 
and Ej comes after E^. Thus it follows from equation ([8]) (with U and D replaced by A^ and E, 
respectively) that the element corresponding to a peak p causes inversions with exactly ht{p) — 1 
elements aj. The —1 comes from the fact that is not an inversion. Summing over all peaks 
completes the proof. □ 

We will show at the end of Section [6] that the bijection F can be used to give alternative proofs 
of Theorems 11.11 and 16.21 

Because of its appearance in the previous proposition, we define a new statistic sumpeaks on 
Dyck paths P by 

speai^ = J2{ht{p) - 1) 

p 

where the sum is over all peaks p of P. There is another statistic that we will now define which 
is equidistributed with sumpeaks. 

If P is a Dyck path with steps U, D and v = DU = SjSj^i is a valley of P then its height, ht(f ), 
is the y-coordinate of its lowest point. For each valley, v, there is a corresponding tunnel, which 
is the factor T = si . . . Sj oi P where Si is the step after the first intersection of P with the line 
y = ht{v) to the left of Sj. The tunnels for the Dyck path in Figure H] are indicated with dashed 
lines. In every tunnel, j — i is an even number, so we define the sumtunnels statistic to be 

stunP= 0'-0/2 

T — Si . ••Sj 

where the sum is over all tunnels T of P. In Figure HI we have stunP = (12 + 6 + 2 + 2)/2 = 11. 
It turns out that the sumpeaks and sumtunnels statistics are equidistributed over T>n. 
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Theorem 4.2. For any n > 1, 

^ ^ ^speaP^npeaP ^ ^ ^stun P^n— des P 

pgx>„ Pe©„ 

Proof. For P G "Dn, let desP = n — desP for convenience. Recall that desP is the number of 
valleys of P. It suffices to define a bijection h : P,„ — )■ P„ such that for any P G "Dn we have 

speaP = stun /i(P) and npeaP = des /i(P). (9) 

Let 5^^{P) = {Q, R) where 6 is the bijection of the Section [31 We inductively define h by /;,(0) = 
and for n > 1 

r UDh{Q) ifP = 0, 

h{P) = I Uh{R)D if Q = 0, 

[ Uh{Q)Dh{R) else. 

To see that h has an inverse, it suffices to check that given P' G we can tell which of the 
three cases above P' must fall into for |P'| > 4. (When |P'| = 2 then bijectivity is clear since 
there is only one Dyck path of this length.) The first case contains all P' starting with a single U . 
The second case covers all P' that are strictly above the x-axis between the first and last lattice 
points which forces them to start with at least two f/'s. And the last case contains those paths 
which start with at least two t/'s and intersect the x-axis before the final vertex. 

We now verify equation ([9]) by induction on n. It is easy to verify for n = 1. For greater n, let 

p = U'W^'U'W^^ . . . U'^D^^, 

where . . . , ik,jk are positive. We have three cases. 

If ji > 2, then Q = U'^'^D^^^^U'W^^ . . . U'^D^^ and P = 0. So, comparing P and Q and 
using the induction hypothesis, 

speaP = speaQ + 1 = stun h{Q) + 1 = stunU Dh{Q) = stun h{P), 
npeaP = npeaQ = des h{Q) = des UDh{Q) = des h{P). 

If ji = ii = 1, then Q = ^ and R = If^^D^^ . . . Using similar reasoning to the first 

case, 

speaP = speaP = stun h{R) = stunUh{R)D = stun h{P), 
npeaP = npeaP+ 1 = desh{R) + 1 = desUh{R)D = desh{P). 

If ji = 1 and ii > 2 then, keeping the notation in the definition of 6, 

Q = u'^-i D^'^U'W^' . . . f/»-/}i=+i-^-i and R = u'^+^D'+^U''+^D^'+^ . . . U'^D'". 

The last peaks of P coincide with all but the first peak of R. The first peak of R and the peaks 
of Q are in bijection with the rest of the peaks of P where a peak of P corresponds to the peak 
of Q (or the first peak of R) which is closest on its right. Let pi, . . . be these peaks of P, 

corresponding to peaks gi, . . . , in Q and ri =^ g^+i in R- Then 

ht(gi) + 1 if = 1, 

ht(pfc) = ht(gfc)+jfc if 1 < A; < s, 

\it{qs+i) + js+i - e-1 ifA; = s + l. 
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Thus we have 

s+1 s+1 s+1 

ht(pfc) = ^ ht(gfc) + j2 H h js+i - e = ^ ht(gfc) + «i H h is- 

fc=i fc=i fc=i 

Hence 

s 

speaP = speaQ + speai? + ^^2fc 

fc=i 

s 

= stun h{Q) + stun h{R) + 

fc=i 

= stun Uh{Q)Dh{R) 
= stun/i(P), 

where the third equahty comes from the fact that Uh{Q)Dh{R) has exactly one more tunnel than 
the union of the tunnels of Q and R, namely the tunnel from the new U to the new D, and that 
tunnel has semilength J2k=i'^k- Additionally, 

npeaP = npeaQ + npeaP = des h{Q) + des h{R) = des Uh{Q)Dh{R) = des h{P), 

completing the proof. □ 



5 A proof of Theorem 11.11 using polyominoes 



In this section we will give a second proof of our main theorem using Theorem 13.11 another result 
of Fiirlinger and Hofbauer, and polyominoes. In particular, we will need a bijection T first defined 
by Cheng, Eu, and Fu [3] between shortened polyominoes and 321-avoiding permutations. We 
first need to define some terms. 

A parallelogram polyomino is a pair {U, V) of lattice paths using steps and E such that 

• U and V begin at the same vertex and end at the same vertex, and 

• U stays strictly above V except at the beginning and end vertices. 

In Figure [5(a) we have U = NNNEENENNE and V = EENENNENNN. Let P„ denote 
the set of all parallelogram polyominoes with \U\ = \V\ = n. Note that if f/ = si . . . s„ and 
V = ti . . .tn then si = tn = N, and s„ = ti = E. Define two statistics 

axea.{U,V) = the area contained inside {U,V), 
col(f/, V) = the number of columns spanned by (f/, V). 

Returning to our example, area(f/, V) = 12 and col{U, V) = 4. Consider the generating function 

{U,V)€Vn 

Another result of Fiirlinger and Hofbauer, which we state here without proof, shows that this 
polynomial is closely related to Cn{a, b; t) as defined in equation ([7]). 
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(a) A polyomino in Vio (b) A polyomino in "Hg 

Figure 5: Parallelogram and shortened polyominoes 

Theorem 5.1 (Fiirlinger and Hofbauer [H]). We have 

Pn+i{q,t)=q''tC^{q,q-\t) 
for all n > 0. □ 

We will also need another type of polyomino. Define a shortened polyomino to be a pair (P, Q) 
of A^, E lattice paths satisfying 

• P and Q begin at the same vertex and end at the same vertex, and 

• P stays weakly above Q and the two paths can share i?-steps but not A^-steps. 

Figure [5t^b) shows such a polyomino. We denote the set of shortened polyominoes with \P\ = 
\Q\ =nhy Hn. 

We can now define the map T : 1-1^ — )■ Avn(321). Given (P, Q) G label the steps of P with 
the numbers 1, . . . , n from south-west to north-east. Each step of P is paired with the projection 
of that step onto Q. Give each step of Q the same label as its pair. Then reading the labels on Q 
from south-east to north-west gives a permutation a = T(P, Q). In Figure [5](b), a = 341625978. 
The next result compares our statistics on "H^ and Av„(321) 

Theorem 5.2 (Cheng-Eu-Fu |21)- The map T : Tin — ?■ Avn(321) is a well-defined bijection such 
that if T(P, Q) = a then 

(a) area(P, Q) = inv cr, and 

(b) col(P,Q) = IrmcT. 

Proof. The fact that T is a well-defined bijection and part (a) were proved in [3], so we will only 
sketch the main ideas here. If T(P, Q) = a, then the left-right maxima of a will label the E steps 
of Q. The positions of these maxima in a are the same as their positions on Q. Thus, as we saw 
in Lemma [2?]T b). this data will determine a unique 321-avoiding permutation provided that the 
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prefix condition is satisfied. And that condition is ensured by the second item in the definition of 
a shortened polyomino. Thus we have a bijection. 

Now suppose a = ai . . . Qn and that we have an inversion > aj where i < j. In that case Oj 
and aj will label an ii^-step and an A^-step of Q, respectively, with the iV-step coming later on the 
path. One can then show that there will be a square inside (P, Q) due north of at and due west 
of aj corresponding to the inversion. This process is reversible, so there is a bijection between 
inversions of a and squares inside {P,Q), proving part (a) of the theorem. And part (b) follows 
from the already-noticed fact that the left-right maxima of a are in bijection with the i?-steps of 
Q. □ 

The final ingredient is a simple bijection between Vn+i and T-Ln- If {U, V) G Vn+i then con- 
tracting the first step of U and the last step of V (both of which are A^-steps) gives (P, Q) G T-in- 
The polyomino in Figure [5](b) is gotten by shortening the one in[5]^a) in this manner. If shortening 
{U, V) gives (P, Q) then we clearly have 

area(f/,F) = area(P, Q) + col(P, Q), (10) 
co\{U,V) = col(P,g). (11) 

Second proof of Theorem 11.11 Theorem 15.21 together with equations (ITO!) and (ITT]) give 
^nilyt) = Pn+i{<l,t/<l)- Combining this with Theorem 15.11 yields 

T (ni\-S q''~'tCn{q,l/q;t/q) if n > 1, 
^"^'^'^^ ~\1 if n = 0. 

Now in Theorem 13. II we replace a, b, and t by g, 1/g, and t/q , respectively. Multiplying both sides 
by and rewriting everything in terms of the corresponding inversion polynomials finishes the 
proof. □ 



6 A major index polynomial recursion 

In the paper of Dokos et al., they asked for a recursion for the 321-avoiding major index polynomial 
which is defined by equation ([T]) with st = maj and tt = 321. The purpose of this section is to 
give such a recurrence relation using polyominoes. 
Consider the polynomial 

Mn{q,t)= J2 g'^'j't'^"'". (12) 

o-eAv„(321) 

Using the description of the bijection T : Tin — > Av„(321) given in the proof of Theorem 15. 2[ 
it is clear that each descent of a corresponds to a factor EN of Q where T~^(cr) = {P,Q) and 
vice-versa. Since the position of the descent in a is the same as the position of the factor on Q, 
we have Des a = Des Q where, as usual, Q is identified with the bit string obtained by replacing 
A^ and E hj and 1, respectively. It follows that des cr = desQ and maj a = maj Q. So we can 
rewrite (fT2l) as 

Mn{q,t)= J2 q'^^'^^t^"^'^ . 
We will need a lemma about what happens if we restrict this sum to the parallelogram polyominoes 

Vn C Tin. 
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Lemma 6.1. We have 

(P,Q)eP„ 

Proof. Let (P', Q') E T-in-i be obtained from (P, Q) G P„ by shortening. Also let us write 
P = Pi . . .pn-iE and Q = qi . . . qn-iN . We have two cases. 
If qn-i = E, then n — 1 G DesQ which implies 

^maj Q^des Q _ ^n— 1+maj Q'^l+des Q' _ ^n— l^^maj Q'^des Q' 

Furthermore, P' and Q' both end with an E step and removal of that common step leaves a 
polyomino in Hn-2- It follows that the {P,Q) in this case contribute q^~HMn-2{q,t) to the sum 
in the lemma. 

For the second case we have = A^. It follows that (P', Q') G "Hn-i where the only 

restriction is that Q' end with a north step. In other words, we want the generating function for all 
polyominoes in 'Hn-i except for those whose lower path ends with an E step (which must coincide 
with the last step of the upper path which is always E). This is clearly Mn-i{q,t) — M„_2(g,t), 
and adding the contributions of the two cases we are done. □ 



Theorem 6.2. For n > 1 we have 

n 

M^{q,t) = M^_,{q,qt) + Y,[Mk-i{q,t) + {q'-H - l)Mk-2{q,t)] M^_k{q,qH), 

k=2 

and 

n-2 

M^{q,t) = M„_^{q,t) + Y,Mk{q,t) [Mn-k-i{q,q''t) + (g"-^ - l)Mn-k-2{<l,<l''t)] • 

k=0 

Proof. To obtain the first equation, suppose (P, Q) G Tin- If both P and Q start with an E step 
then the generating function for such pairs is Mn-i{q,qt) since each descent of Q is moved over 
one position. 

Since Q always starts with an £^-step, the only other possibility is for P to start with an 
iV-step. Let z be the first point of intersection of P and Q after their initial vertex. Let Qq and 
Qi denote the portions of Q before and after z, respectively, and similarly for Pq and Pi. Let 
k — \Qo\ = I -Pol- But then Pq and Qo do not intersect between their initial point and z. Thus 
(Po, Qo) G Vk and, from the previous lemma, the generating function for such pairs is the first 
factor in the summation. 

We also have \Qi\ = \Pi\ = n — k and (Pi,Qi) G Tin-k- Since Qi is preceded by a path with 
k steps, each of its descents will be increased by k. So the generating function for such pairs is 
Mn-k{q,q'^t). Putting all the pieces together results in the first formula in the statement of the 
theorem. 

To obtain the second, merely replace z in the proof just given by the last point of intersection 
of P and Q before their final vertex. □ 
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We end this section with the observation that there is a close connection between the maps T 
and T defined in Sections H] and El respectively. Specifically, the inverse of T : Av„(321) — )• Vn 
coincides with the composition of the bijection from D„ to Tin used in [TT] to prove Theorem 15.11 
with the bijection T : Tin Av„(321). So one can use T in place of T in some of the proofs. 
For example, the equation In{q,t) = q^~HCn{q,l/q]t/q) which appears in the second proof of 
Theorem 11.11 can also be obtained from F as follows. If tt G Av„(321) and F(7r) = P, then by 
Proposition 14.11 and the definitions in Section [31 we have 

inv(7r) = speaP = n + a{P) - f3{P) -npeaP = n - 1 + a{P) - l3{P) - desP, 
lrm(7r) = npeaP = 1 + desP. 

Thus, 

/n(g,t) = J2 g^'^'^^V'^^^^ = q^'-Hc^iq, i/q;t/q). 

PeVr, 

Theorem 16.21 can also be proved using the bijection F. Note that each descent in a permutation 
71 G Av„(321) corresponds to an occurrence of the string NEE in the Dyck path F(7r). Thus the 
statistics des and maj in vr correspond to the number of occurrences and the sum of the x- 
coordinates after the first E in each occurrence of NEE in F(7r), respectively. Using the standard 
decomposition of a non-empty Dyck path as P = NQER where Q and R are Dyck paths, as well 
as its reversal, we can keep track of these two statistics to obtain the recursions in Theorem 16.21 

7 Symmetry, unimodality, and mod 2 behavior of Mn{q,t) 

The coefficients of the polynomials Mn{q, t) have various nice properties which we now investigate. 
If f{x) = a^x'^ is a polynomial in x then we will use the notation 

[x^]f{x) = coefficient of a;'^ in /(x) 
= flfc- 

Our main object of study in this section will be the polynomial 

AnM = [t']Mn{q,t). 

In other words, An^k{q) is the generating function for the maj statistic over a G Av„(321) having 
exactly k descents. 

The first property which will concern us is symmetry. Consider a polynomial 

s 
i=r 

where a^., 7^ 0. Call f{x) symmetric if a, = aj whenever i + j = r + s. 
Theorem 7.1. The polynomial An,k{q) is symmetric for all n, k. 
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Proof. If (J is counted by y4„ fc(g) then des cr = k. Since a avoids 321, it can not have two 
consecutive descents and so the minimum value of k is 



1 + 3 + ■ ■ ■ + (2A; - 1) = 



and the maximum value is 



{n-l) + {n-d,) + --- + {n-2k + l)=nk-k'^. 



So it suffices to show that for < i < n/c we have 



ank-i where 



Let Ai be the permutations counted by and let i?i8o denote rotation of the diagram of cr by 
180 degrees. We claim i?i8o is a bijection between Ai and Ank-i which will complete the proof 
First of all, -Ri8o(321) = 321 and so a avoids 321 if and only if _Ri8o(o") does so as well. IfaEAi then 
let Descr = {di, . . . ,dk} where '^jdj = i. It is easy to see that Desi?i8o(o") = {n — di,... ,n — dk}. 
It follows that maj i?i8o(c") = nk — i and so i?i8o(o") G Ank-i- Thus Riso restricts to a well defined 
map from Ai to Ank-i- Since it is its own inverse, it is also a bijection. □ 

Two other properties often studied for polynomials are unimodality and log concavity. The 
polynomial f{x) = J2i=o unimodal if there is an index r such that < . . . < > . . . > as- 

It is log concave if of > aj_iaj+i for all < i < s. If all the are positive, then log concavity 
implies unimodality. 

Conjecture 7.2. The polynomial An^k{(l) is unimodal for all n, k. 

This conjecture has been checked by computer for all A; < n < 10. The corresponding conjecture 
for log concavity is false, in particular, Aq 2 is not log concave. 

The number-theoretic properties of the Catalan numbers have attracted some interest. Alter 
and Kubota [T] determined the highest power of a prime p dividing Cn using arithmetic means. 
Deutsch and Sagan [4J gave a proof of this result using group actions for the special case p = 2. 
Just considering parity, one gets the nice result that Cn is odd if and only if n = 2™ — 1 for some 
nonnegative integer m. Dokos et al. proved the following refinement of the "if direction of this 
statement. 

Theorem 7.3 (Dokos et al. [5]). Suppose n = 2"^ — 1 for some m > 0. Then 



In the same paper, the following statement was made as a conjecture which has now been 
proved by Killpatrick. 

Theorem 7.4 (Killpatrick [I3]). Suppose n = 2™ — 1 for some m > 0. Then 




□ 




□ 
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Figure 6: The diagram of 132[cri, (T2, as] 



We wish to prove a third theorem of this type. To do so, we will need the notion inflation 
for permutations. Given a permutation vr = ai . . . a„ G ©„ and permutations cri,...,(Tn, the 
inflation of tt by the o"j, written 7r[o"i, . . . , cr„], is the permutation whose diagram is obtained from 
the diagram of tt by replacing the dot (i, Oj) by a copy of cxj for 1 < i < n. By way of example, 
Figure [6] shows a schematic diagram of an inflation of the form 132[(Ti, cr2, ca]- More specifically, 
132[21, 1,312] = 216534. 

Theorem 7.5. Suppose n = 2™ — 1 for some m > 0. Then 

[t^]M„(i, t) = An fc(i) = I ^ . , ? f r ?' 

^ V ' / . \ / 1^ an e^jen integer if k > 1. 

Proof. We have An,o{q) = 1 since a = 12 ... n is the only permutation without descents and 
it avoids 321. 

If /c > 1, and An^kig) has an even number of terms then An^k{^) must be even because it is a 
symmetric polynomial by Theorem 17. II By the same token, if An^kig) has an odd number of terms, 
then y4„_fc(l) has the same parity as its middle term. Now consider i?i8o acting on the elements 
of Ank/2 as in the previous proof. Note that since n is odd, k must be even. Furthermore, this 
action partitions Ank/2 into orbits of size one and two. So it suffices to show that there are an 
even number of fixed points. If a is fixed then its diagram must contain the center, c, of the 
square since this is a fixed point of -Riso- Also, the NW and SE quadrants of a with respect to c 
must be empty, since otherwise they both must contain dots (as one is taken to the other by -Riso) 
and together with c this forms a 321. For the same reason, the SW quadrant of a determines the 
NE one. Thus, the fixed points are exactly the infiations of the form a = 123 [r, 1, Riso{t)] where 
r G Av2m-i_]^(321) has k/2 descents. By induction on m we have that the number of such r, and 
hence the number of such a, is even. □ 



8 A refinement of Theorem 11.11 using continued fractions 



We will now use a modification of the bijection in Section |2] together with the theory of continued 
fractions to give a third proof of Theorem 11.11 In fact, we will be able to keep track of a third 
statistic on permutations a, namely 

fixo" = the number of fixed points of a. 

So consider the following polynomial 

o-GAv„(321) 
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and the generating function 

J{q, t, x;z) = In{q, t, 

n>0 

It is worth noting that 

In{q,t,x/t)= J2 (13) 

o-GAv„(321) 

where exccr is the number of excedances of a (i.e., the number of indices i such that a{i) > i). 
This follows from the following fact. 

Lemma 8.1. Suppose a = 0102 ■ ■ ■ a„ G Av„(321). Then ai is a left-right maximum if and only if 
tti > i. Consequently, Irmo" = exccr + fixer. 

Proof. If tti is a left-right maximum, then is greater than the i — 1 elements to its left in a, so 
tti > i — 1. Conversely, if is not a left-right maximum then it is smaller than some element to 
its left in a. Also, by Lemma [2.1( a). it is smaller than all n — i elements to its right in a. This 
implies that n — a^ > n — i + 1, whence < i — 1. □ 

Continued fractions are very useful for enumerating weighted Motzkin paths M. If s is a step 
of M then we defined its height to be 

ht(s) = the y-coordinate of the initial lattice point of s. 

If ht(s) = i then we assign s a weight wt s = Ui, di, or corresponding to s being an up, down, or 
level step, respectively. Weight paths M = si . . . s„ and the set ^An of all such Motzkin paths by 

n 

wt M = Y\ "Wt Sj 

i=i 

and 

wt Mn = ^ wt M. 

MeMn 

For example, taking the path M in Figure [1] would give (ignoring the subscripts on the L's) 
wt M = uolluil2d2hdi. 

In the sequel, we will use the following notation for continued fractions 

a-il ao\ a^il cti , , 

F = ^±^±^±--- = . (14) 

|oi |02 I03 a2 

hi ± 

ho ± 



63 ± ■ ■ ■ 

We can now state Flajolet's classic result connecting continued fractions and weighted Motzkin 
paths. 

Theorem 8.2 (Flajolet [lO])- If z is an indeterminate then 

E „ 1| UQdiz^\ uid2Z^\ U2d^z^\ 

n>0 I u I 1 I z I d 

is the generating function for weighted Motzkin paths. □ 
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Figure 7: The Motzkin path i/(cr) associated with a = 361782495 



We will also use the same classification of continued fractions employed by Flajolet [lOj which 
defines a Jacobi-type continued fraction as a continued fraction of the form 



bnZ 



hiz 



\l-boz 



X.z'l 



b-^z 



and a Stieljes-type continued fraction as a continued fraction of the form 



S{z) 



11 



\iz\ X2Z\ Xsz\ 



Following the book of Jones and Thron [12], a continued fraction of the form 



T{z) 



11 



A, 



A, 



\1 -bcz 



\1 — biZ |1— 62-2 |1^^3-2 



will be called a Thron-type continued fraction. 

In order to derive a continued fraction expansion for 3{q,t,x; z), we will set up a bijection 
between Av„(321) and a subset of Ain . Call M G Ain restricted if it has no Lq steps at 
height 0. Let TZn be the set of such paths. In the following proof, we will use the same definitions 
and notation as in Section O 

Theorem 8.3. The series 3{q,t,x; z) has Jacobi-type continued fraction expansion 



3(q,t,x; z) 



tqz 



,3^21 



tq-^z 



5^21 



tq^z 



\l-txz \l-{l + t)qz \l-{l + t)q^z \l-{l + t)q^z 

Proof. We define a bijection v : Av„(321) — )■ 7^„ in a way similar to the bijection /i in the first 
proof of Theorem 11.11 but without the shift. Specifically, given a = ai . . . a„ G Av„(321) with 
val a = (f 1, . . . , Vn) and pos a = {pi, . . . , pn), we let ^{a) = M = si . . . Sn where 

' U if Vi = and pi = 1, 
D if f j = 1 and Pi = 0, 

Lq if Vi=Pi = 0, 

^Li i{vi=pi = l. 

Continuing the example from the beginning of the paper, a = 361782495 would be mapped to the 
path in Figure [71 
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We must show that v is well defined in that M G T^n- Defining the inverse map and proving 
it is well defined is similar and so left to the reader. The fact that M is a Motzkin path follows 
because, by Lemma 12.1( b). in every prefix of posu the number of ones is at least as great as 
the number in the corresponding prefix of valcx, with equality for all of a. This forces similar 
inequalities and equality between the number of up-steps and the number of down-steps in M. 
Thus M stays weakly above the x-axis and ends on it. 

To see that M has no Lo-steps on the x-axis, note first that all steps before the first f/-step 
(if any) must be of the form Li because, if not, then the index i of the first such Lg-step would 
contradict Lemma 12.1( b). Also, any time M returns to the a:-axis, it must be with Sj = D for 
some j. So the corresponding prefixes of vala and poser have the same number of ones and this 
implies that ai . . . aj are 1, . . . , j in some order. Now using an argument similar to the one just 
given, one sees that there can be no Lo-step before the next f/-step. This completes the proof that 
fj, is well defined. 

We now claim that 

fixo" = the number of Li-steps at height 0, (16) 
Irma = #f/(M) + #Li(M), (17) 
invo" = areaM. (18) 

Let us prove the first equation. If sj = Li with ht(sj) = then, as in the proof that u is well 
defined, ai . . . aj-i are the numbers 1, ... ,j — 1 in some order. Thus if vj = pj = 1 then both the 
position and value of aj correspond to a left-right maximum. This forces aj = j and so we have a 
fixed point. Similar considerations show that every fixed point in a 321-avoiding permutation is a 
left-right maximum corresponding to an Li step at height 0. 

Equation f[T7|) follows immediately from the fact that the number of left-right maxima in cr 
equals the number of ones in poser, and the corresponding steps in M are of the form U or Li. 

For the final equality, first recall that all inversions of a are between a left-right maximum m 
and a non-left-right maximum to its right by Lemma [2. 1( a). So if m is in position p then, because 
everything to its left is smaller, it creates m — p inversions. Also, the maximum values and their 
positions in cr are given by ivi and jpj, respectively, whenever Vi,pj = 1. Since ivi = jpj = 
whenever Vi,pj = we have 

n 

inv a = ^ iVi - ^ jpj = ^{vi - Pi)i. 

As far as the area, we start by noting that areaM = Ylij^'^^i- Furthermore, ht(sj) is just 
the difference between the number of up-steps and down-steps preceding Sj. For any step Sj, we 
have Pi — Vi = 1, —1, or corresponding to Sj being an up-, down-, or level-step, respectively. So 
ht(sj) = '^i^j{Pi — Vi). Combining expressions, interchanging summations, and using the fact that 
val a and pos cr have the same number of ones, gives 

n n n 

areaM = "^"^{Pi - v-i) = "^[{n - i)pi - {n - i)vi] = "^{vi - Pi)i. 

j=l i<j i=l i=l 

Comparing this expression with the one derived for inv cr in the previous paragraph completes the 
proof of 
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To finish the demonstration of the theorem, we just need to set the weights in Theorem 18.21 in 
light of ( I16p -( 1TB]) . The only level steps at height are Li which contribute to both fixer and Irmcr. 
So we let Iq = tx. At heights > 1 we have both Lq and Li steps. The former only contribute to 
inv by adding /i, while the later also increase the Irm statistic by one, so we have Ih = + t)q^ ■ 
Similar reasoning gives Uh = tq^ and dh = which, after plugging into equation ( ITSjl . completes 
the proof. □ 



The following refinement of Theorem 11.11 is a simple consequence of the preceding result. 
Theorem 8.4. For n > 1, 

n-2 

In{q,t,x) = txln-i{q,t,x) + '^q^^^Ikiq,t, 1) [/„_i-fe(g, t, x) - t{x - l)/„„2-fc(g, x)] . 

k=0 

Proof. We can derive from the continued fraction expansion of 3{q,t,x] z) in Theorem 18.31 that 

1 



3{q,t,X]z) = 

tqz'^ 



txz 



1 

-qz + 



3{q,t,l;qz) 

After simplification, this leads to the functional equation 

3{q, t,x; z) = 1 + txz3{q, t, x; z) + qz3{q, t, 1; qz) [3{q, t,x; z) — 1 — tz{x — l)3{q, t, x; z)] . (19) 

Extracting the coefficient of z"' on both sides gives the desired recursion. □ 

We note that the q = I case of the functional equation ( !T9|) is, by ( IT3|) . equivalent to equation (1) 
in [6]. It can be explicitly solved as done in equation (2) of the work just cited. 

One can simplify the continued fraction in Theorem 18.31 in the case x = 1. The nth convergent 
of the continued fraction (IT^ is 

c„(F) = ^±^±...±^. 

\bi \b2 \bn 

We wish to construct continued fractions, called the even and odd parts of F and denoted F^ and 
Fo, such that C2„(-F) = c„(Fe) and C2n+i{F) = c„(Fo), respectively. The following theorem shows 
how to do this when &„ = 1 for all n. 

Theorem 8.5 ([I2j). We have 

Oiil CI2 1 1 C^i I '22'^3| ^4*^5! '^6*^7 1 

1 1 1 1 1 1 1 1 + (32 1 1 + 03 + 04 1 1 + 05 + 1 1 + 07 + flg 

Ol(32| '3'3'34| (35(3g| flyOgl 

= ai 



1 1 + 02 + 03 1 1 + 04 + 05 1 1 + ag + 07 1 1 + ag + ag 
as even and odd parts, respectively, of the first continued fraction. □ 
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Using the concept of even and odd parts, we see that there is a simple and well-known rela- 
tionship between Stieljes- and Jacobi-type continued fractions [121 p. 129]. More precisely, taking 
the even part of a Stieljes- type continued fraction gives 

1| Ax2;| ^22^1 1| AxA2^'^| A3A42;'^| AsAg^'^l 



|1 |l-Ai2; |l-(A2 + A3);z |l-(A4 + A5)-2 |1-(A6 + A7)2; 



where the right-hand side is of Jacobi type. Combining Theorem 18.31 when x = 1 with the above 
equation, we get the following result. 

Corollary 8.6. Set J{q, t; z) := t, 1; z). The generating function J{q, t; z) has the Stieltjes-type 
continued fraction expansion 

^ 1| tz\ qz\ tqz\ q^z\ tq^z\ q^z\ tq^z\ q'^z\ tq'^z\ , 

^W,^,^) = p- - ^ - ^ - ^ ^ ^ ^ ^ ^ ^ ( ) 

It is interesting to note that there is a second recursion for which follows from a result 

of Krattenthaler. 

Theorem 8.7 (Krattenthaler [S]). We have 

„/ N ll Z\ Z\ Z\ 

3{q,t; z) 



\l-{t-l)z \l-{tq-l)z \l~{tq^-l)z 
as the Thron-type continued fraction expansion of 3{q,t; z) . □ 
Corollary 8.8. For n > 1, 



n-2 



Iniq, t) = tln-l{q, + ^ t)In-l-k{q, Qt)- 



k=0 

Proof. Simple manipulation of the continued fraction in Krattenthaler's Theorem gives the func- 
tional equation 

3{q, t; z) = 1 + {t - l)z3{q, t; z) + z3{q, t; z)3{q, qt; z). 

Taking the coefficient of z"^ on both sides of this equation finishes the proof. □ 

It is worth noting that, a priori, it is not at all clear that the recursions in Theorem 11.11 and 
the above corollary generate the same sequence of polynomials. The relationship between these 
two recursions can be interpreted in terms of the statistics sumpeaks and sumtunnels, introduced 
in Section HI as follows. Using the standard decomposition of non-empty Dyck paths as P = 
NQER, where Q and R are Dyck paths, the generating function for with respect to the 
statistics (spea, npea) satisfies the recursion in Corollary 18.81 On the other hand, using the same 
decomposition, the generating function for Vn with respect to the statistics (stun, n — des) satisfies 
the recursion in Theorem II. 1[ Thus, Theorem 14.21 implies that the two recursions are equivalent. 
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9 Refined sign-enumeration of 321-avoiding permutations 



Simion and Schmidt ^17j considered the signed enumeration of various permutation classes of the 
form YlaeAv„{-K)i~^y^'"^ ■ ^^^^ section we will rederive their theorem for Av„(321) using the 
results of the previous section. In addition, we will provide a more refined signed enumeration 
which also keeps track of the Irm statistic. We should note that Reifegerste [15] also has a 
refinement which takes into account the length of the longest increasing subsequence of cr. 

Let Cn be the nth Catalan number and consider the generating function C{z) = J2n>o^n^^- 
It is well known that C{z) satisfies the functional equation C{z) = 1 + zC(z)^. Rewriting this 
as C{z) = 1/(1 — zC{z)) and iteratively substituting for C{z), we obtain the also well-known 
continued fraction 



ll 


z\ 


z\ 


z\ 


z\ 


z\ 


ll 


ll 


ll 


ll 


ll 


ll 



C{z) 

Now plug q = —1 and t = 1 into the continued fraction (1201) to obtain 

ll z\ z\ z\ z\ z\ z\ z\ z\ z\ z\ z\ 

J(-i,i;.-)=l|-^+|j+l|-|j-|j+l| + ^-^-|| + ^+l| 

Using Theorem 18.51 to extract the odd part of this expansion gives 
3(-lA:z) -- 



z\ z'^l z'^l z'^l z'^l z'^\ 



' ' " " ' ll ll ll ll ll ll 

Comparing this to the continued fraction for C(z), we see that 

J(-l, l;z) = l + zC{z^). 
Taking the coefficient of on both sides yields the following result. 
Theorem 9.1 (Simion and Schmidt [17]). For all n > 1, we have 

/2.(-l,l)= Yl (-1)'"''' = and Wi(-l,l)= Yl i-^r"'' = Cn. 

creAv2„(321) creAv2„+i{321) 



□ 



Since our refined sign-enumeration will involve the parameter Irm, we recall (but will not use) 
the folklore result that the enumerating polynomial of Av„(321) according to the Irm statistic is 
the nth Narayana polynomial, i.e., 

n 

/„(i,t)= Yl ^''"" = E^"'^^'' 

CTeAv„{321) k=l 

where the Narayana number Nn^k is given by Nn^^ = ^(^) (^"1) for n > A; > 1. 
Theorem 9.2. For all n > 1, 

n 

j„(-i,t)= Y (-1)'°"'^^''^"'^ = 5Z(-ir"W^' (21) 

o-eAv„(321) k=l 
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where Sn,k is defined for n > k > 1 by 
Moreover, 



J2„(-l,t) = (t-l)/2„-l(-l,t), (22) 

(n + l)/2„+i(-l,t) = 2{{l + t^)n-t)hn-i{-l,t)-{l-t^y{n-l)hn-3{-ht). (23) 
Proof. Let J{t; z) and Joddit; z) be the power series defined as 

J(t;z) = ^4(-l,t);2" and '3oM{t] z) = Y,hn+i{-l.t)z^ . 

n>0 n>0 

By equation (I2U|) . we have 

^ ' ^ |1 |1 |1 |1 |1 |1 |1 |1 |1 |1 |1 |1 

1 



tz 



1 



tz 

1 + 



1 - zJ{t- z) 

which, after simphfication, leads to the functional equation 

{l + z- tz)z 3{t; zf -{l + 2z + z^ - t^z^) 3{t; z) + {l + z + tz) = 0. 
Solving this quadratic equation, we obtain 



^ 1 + 2;^ + (1 - t')z' - y/l - 2(1 + t^)z^ + (1 - t^) V 

2zil + z-tz) ■ ^ ' 

Noticing that 3odd(t', z) = (J(t; i/i) — 3(t] —y/z))/2y/z and using (IMl) . we obtain after a routine 
computation 

l-(l-t)^^- v/l-2(l+t^)^ + (l-tT^^ 

= 2z{i-{i-tyz) • 



It follows from that 

{l + z- tz)3{t; z) + {l- z + tz)3{t; -z) = 2. 

Extracting the coefficient of z"^"- on both sides of the last equahty, we obtain (l22l) . Using (!25|l . it 
is easily checked that 3odd satisfies the differential equation 

z{l - 2(1 + t^)z + (1 - t^fz^) 3',Ut; z) + {l-2{l-t + t^)z + (1 - t')'^')) 3odd{t; z)-t = 0, 
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where 2forfrf(t; z) is the derivative with respect to z. Extracting the coefficient of z^ on both sides 
of the last equahty, we obtain (1231) . 



We now turn our attention to fl2T]) . Clearly, we have 

= [t>^,n f^odd{Vi;z)-3M-Vi;z) ^ ^ (26) 

/A/t a/1 — 2(1 + t)^; + (1 — tj^z^ 



where the last equality follows from (|25|) . Using the Lagrange inversion formula, we can show that 
[-^"] , = = [x"](l + (l+t)x + te')". (27) 

^ Vl-2(l + t)z+(l-t)222 L JV V ; ; V ; 

Combining (!26|) with the above relation, we obtain 



[t''"^']/2n+l(-l,t) = [x1[t1(l + (l+t)x + te2)"=[x"]Qx'=(l + x)"= Q . (28) 

Similarly, we have 

[t'1/2n+i(-l,t) = [t>'z-^ ^''^^iVi;z)+3oMi-Vi; z) ^ ^^,^^^„, 1 l-z-tz 



2 ^ "Iz 2z^\-2{\^t)z^{\-tfz'' 

This, combined first with (126|) and then (128|) . yields 

r]Wl(-l,t) = ^([P+^]Wl(t,-l) + [t^'^-^]Wl(t,-l)-[t''+^]W3(t,-l)) = -(^! i) (fc 

This proves that fl2Tl) is true when is odd. Combining this with (|22|) shows that the formula also 
holds when ra is even. □ 

To see why the previous result implies the one of Simion and Schmidt, plug t = \ into the 
equations for /2n(— l,t) and /2„+i(— l,t). In the former case we immediately get /2„(— 1, 1) = 
because of the factor of t — 1 on the right. In the latter, we get the equation (n + l)J2„+i(— 1, 1) = 
2(2n - 1) 

-^2n-i(~l) 1)- The fact that /2n+i(— 1, 1) = C'n now follows easily by induction. 
Finally, it is interesting to note that the numbers s^^k which arise in the signed enumeration of 
Av„(321) have a nice combinatorial interpretation. Recall that symmetric Dyck paths are those 
P = S\. . . Sin which are the same read forwards as read backwards. The following result appears 
in Sloane's Encyclopedia [H]: For n > A; > 1, the number Sn^k is equal to the number of symmetric 
Dyck paths of semilength n with k peaks. 
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